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Some  Concepts  of  Multivariate  Dependence 
by 

Henry  W.  Block  and  Mei-Ling  Ting 
University  of  Pittsburgh 


Abstract 


Several  types  of  positive  dependence  are  shown  to  be  equivalent 
to  the  concept  of  a  distribution  with  a  density  which  is  TP^  in  pairs. 
Among  these  is  the  concept  of  mA. positive  dependence  of  Alam  and  Wallenius 
Using  this  result,  all  relationships  among  many  of  the  most  important 
concepts  of  positive  dependence  are  determined.  Furthermore,  an  appli- 
cation  of  the  equivalences  of  these  types  of  positive  dependence  yields  a 
result  of  Ahmed,  Langberg,  Leon  and  Proschan.  _ 


Research  has  been  supported  by  ONR  Contract  !Mf6l4-76-C-{(839. 

1980  Mathematics  subject  classifications:  ^ 

Primary  62H20;  Secondary  62N05, Key  words  and  phrases:  TP^  in  pairs 
m>positlve  dependence,  conditionally  increasing  in  sequence,  right  tall 
increasing  in  sequence,  positively  orthant  dependent,  association. 
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1.  Introduction 


In  a  vide  variety  of  situations,  one  is  interested  in  the 

probability  that  an  n-variate  random  vector  X  *  (X1M..X  )  takes 

1  n 

certain  values.  If  the  vector  does  not  have  Independent  components, 
these  probabilities  can  be  quite  difficult  to  obtain.  However,  in 
many  applications  it  is  often  the  case  that 

n 

ixn^  i  *  P^Xi— xi^  (1*1) 

or 

n 

P{X.  >  x. , • • .  ,X  >  x  >  >  7t  P{X4  >  x, )  •  (1.2) 

i  x  n  n  -  ,  l  l 

1-1  *w 

That  iSj the  joint  probabilities  are  higher  than  if  the  random  variables 
were  Independent  and  consequently  the  Joint  probabilities  can  be 
estimated  from  below  through  only  the  knowledge  of  the  marginal 
distributions.  Random  vectors  which  satisfy  these  basic  inequalities 
are  said  to  be  positively  orthant  dependent.  These  concepts  have 
recently  been  studied  by  Ahmed,  Langberg,  Leon  and  Proschan  (1978) 
(henceforth  ALLP  (1978))  and  by  many  other  authors  cited  in  that  paper. 

A  stronger  type  of  positive  dependence  is  exemplified  by  the 
situation  where 

PtXf  >  |  Xj  >  a^,  j  +  i)  increases  in  a  j .  (1.3) 

This  Is  a  special  case  of  a  concept  studied  by  Harris  (1970)  and 
also  by  Alam  and  Wallenlus  (1976).  This  condition  arises  in 
situations  where  X^  can  be  thought  of  as  an  unobservable  performance 
variable  and  the  X^  are  observable  test  variables.  The  condition 
can  be  Interpreted  as  meaning  that  the  probability  of  the  performance 
varliblc  increases  if  the  test  variable  requirements  are  increased. 
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One  of  the  alms  of  the  paper  of  Alam  and  Wallenlua  (1976)  as 
well  as  many  other  authors  (e.g.,  see  Chapter  5  of  Barlow  and  Proschan) 


Is  to  obtain  simple,  checkable,  conditions  under  which  this  latter 
type  of  dependence  as  well  as  (1.1)  and  (1.2)  hold.  Although  in  the 
bivariate  case,  these  results  are  known,  in  the  general  multivariate 
case  there  have  only  been  fragmentary  results.  In  particular,  Alam 
and  Wallenlus  (1976)  show  that  a  certain  condition,  called  in¬ 
dependence,  Implies  (1.3),  while  Barlow  and  Proschan  (1975)  summarize 
some  concepts  which  imply  (1.1)  and  (1.2).  In  particular,  these 
latter  authors  show  that  if  a  distribution  has  a  density  which  is 
TP j  in  pairs,  then  the  distribution  satisfies  several  other  concepts 
of  positive  dependence. 

In  this  paper  we  show  in  the  Theorem  of  Section  2,  that  the  Alam 
and  Wallenlus  concept  of  m*-dependence  is  actually  the  same  as  the 
concept  of  TP^  in  pairs,  a  property  satisfied  by  a  wide  variety  of 
multivariate  distributions.  Hence,  as  a  corollary  to  this  Theorem 
we  obtain  that  all  of  these  distributions  have  the  dependence 
properties  studied  by  these  authors.  Furthermore,  we  show  that 
several  other  concepts  are  equivalent  to  the  concept  of  TP^  in 
pairs.  As  another  corollary  we  obtain  a  general  result  of  ALLP  (1978) 
on  positive  dependence,  a  result  which  required  a  much  more 
Involved  proof  originally. 

In  Section  3,  as  a  consequence  of  Section  2,  we  are  able  to 
completely  determine  all  relationships  among  the  various  concepts 
of  positive  dependence  studied  by  the  authors  mentioned  above. 
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2.  Definitions  and  Main  Result 

Let  X  ■  (X. , • . . ,X  )  be  an  n-variate  random  vector  with  density 
”  1  n 

f(x)  ■  f (Xj,...,xn).  We  say  £  ot  f  is  TP^  in  pairs  if  for  any 
i  +  J  and  for  x^  <  x’,  xj  <  xj 


f(xi,xj,x(i,j))f(xi,,xj',x^’j;)  *  f(x;,xj,x^*^)f(xi,xj’,xU*J>) 


r(i»j) 


(i» j)' 


.(i.j). 


for  all  x(1^>  -  Multivariate 

distributions  which  satisfy  this  can  be  found  *n  the  examples  and 
problems  of  Chapter  5  of  Barlow  and  Proschan  (1975)  and  also  in  Karlin 

•v_ 

(1968),  p.  19* 

Throughout  the  paper  we  use  the  term  "increasing"  to  mean  "non¬ 
decreasing". 

Alam  and  Wallenius  (1976)  define  the  components  of  the  random 
vector  X  *  (X^^, . . .  ,X^)  to  be  m*-positively  dependent,  if  for 
i  *  !,.«•, n  the  conditional  distribution  of  given 

x(1)  -  (Xlf ,Xi+1,...,Xn)  is  positively  likelihood  ratio 
dependent  on  i.e.  if  the  conditional  density  g(XjJx^*^) 

exists  such  that,  whenever  xj!?=  x^  and  x’^  ^  x^ 

g(x’|x(1)  -  x,(i))g(x1|x(1)  -  x(i))  >  g(x’|x(1)  -  x(i))g(x1|X(i)  -  x,(1)), 
for  i  •  l,2,...,n. 

Ahmed,  Langberg,  Leon  and  Proschan  (1978)  define  jt.to  be 
totally  positive  by  deletion  (TPD)  if  X  has  a  density  f  satisfying 

If (xx , . . . ,x1_1 ,Xj ,x1+1 , . . . ,xn)  f (*i * • • • »*!_! »xi*xi+i •••••*„> I 


!*(*{»•••  »xi_i  »xj  »xi+i » •  •  •  *xn*  f  (x| , . . .  »xj[+i » •  •  •  I 
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f  ' 

for  all  Ji  1  ■  1, 2, . . . ,n. 

Consider  the  notations  xvy  ■  (x,  vy. , . . .  ,x  yy  )  and 

1  1  n  n 

(xlA  yl***,,xn/' yn)f  whcre  xkVyk  *  max*xk»  Vk1, 
yk  ■  ®in  <xk,yk}  and  let  (xj,...,xn)  <  (y1,...,yn)  iff 

xjt  1  *or  k  *  1 1  •  ,n. 

Kemperman  (1977)  shows^ in  a  more  general  setting  than  we  consider 
here} that  if  X^%ee«,Xn  have  the  joint  density  f(x)  where  £(x)  >  0  for 
Jl  e  Q  »ini  Q^.avR^and  if  f(x)  is  TP2  in  pairs,  then 
f(x)  f(^)  £  f(x  A  y)  f(;Vy)  for  all  x,  y  c  ft. 

This  last  result  is  important  in  the  following  theorem  in  which  it 
is  shown  that  these  four  concepts  are  equivalent. 

Theorem  1,  Let  xi»****xn  have  Joint  density  f  (x ) *  where 

f(x)  >  0  for  all  x  c  ft  *  tt.  ft*,  ft.CR1,  then  the  following  four  statements 
^  +*  i=l  i  i 

are  equivalent; 

(1)  yi*y2*"’’*n  are  m*-posltlvely  dependent 

(2)  X1#X2,...,Xn  are  TPD 

(3)  f (xi*x2»* • • *xn>  i*  TP2  *n  Pa*rs 

(4)  f(x)f(y)  <  f(j  /\  y)f  (x  v  y)  x,y  c  SI  c  Rn. 

Proof : 

(1)  =*  (2)  This  result  Is  obvious. 

(2)  =?■  (3)  In  the  definition  of  TPD  take  any  x^  <_  x^,  x^  <_  xj  for  J  I*  1 

and  take  xfc  •  x^  for  k  -  l,2,...,n  with  k  t  J,  k  +  1. 


(3)  —r*  (4)  (Keapernan  1977) 
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By  permit In g  the  Indices  If  necessary,  we  may  consider 
x,y  c  Rn  such  that  xfc  >  for  k  -  l,...,r,  and 

x^  <_ y^  for  k  «  r+l,...,n.  Let  s  -  n-r.  Now  for 
0  <  1  <  r,  0  j  <_  s  define: 


(*1^  yl . xi  v  yl,xi+l  A  yl+l . xr  A  yr ’ 

xr+l  v  yr+l . *r+j  v  yr+J*  xr+j+l  A  yr+j+l* 


*Xn  A  yn> 


then 


r,0  0,s  0,0 

t  ’  •  x,  *  ■  j,  i  • 


Bay,  * 


*,* 


x  v  jr. 


Since  zi+**^  and  z*’^+*  differ  only  at  the  (i+l)ttl  and 
the  (r+J+l)**1  coordinates,  z*+*’^.a  z*'^+*  «  z**^, 

x****^v  g1-*1  -  and  since  the  density  is  TP^ 

In  pairs 


, ,  r;‘  V  ti£hhis£!2± 

“  1-0  J-0  f(zi,J)f(zi+1,j+1) 


f(z°*°)f(;r*8) 


f (x)f (a) 

f  (x  a  y)f  (x  v  jr) 


(♦)  (1)  Take  x  -  (x^,x'^*\  y  •  (x^,x^)  where  xfc  <_  x^,  then 

x  />  y  •  (x^,x^),  x  v  j  •  (Xj,x'^^)  and 

f(x)f(y)  >_  f(x  a  y)f  (x  v-  y).  (1)  follows  just  by  dividing 

through  on  both  sides  by  appropriate  marginal  densities  which  must 
be  positive  on  the  appropriate  projections  of  0. 

Note:  As  ament ioned  in  Kemperman  it  should  be  noticed  that 

(3)  does  not  imply  (2)  without  the  assumption  that  f(x)  >  0  on 

0  of  the  form  in  the  theorem.  The  simple  counterexample  given  is 

fO^x^)  -  Jj  if  0  *  Xj  <_  1,  0  <  ij  <  1,  1  <  x3  £  2, 

*  * 

•*  if  1  <  x^  <  2,  1  <  Xj  <.  2,  0  <_  x^  £  1, 


0  otherwise 
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Several  corollaries  to  the  above  result  can  now  be  stated.  The 
first  is  a  new  result  and  allows  us  to  relate  the  various  nultivariate 
concepts  of  positive  dependence.  The  second  corollary  is  a  slightly 
more  general  version  of  the  interesting  result  of  ALLP  (1978)  and  this 
follows  Immediately  from  the  first  corollary. 

Corollary  1:  Let  (X^,...^)  have  a  density  f(x^»...txn)  which 
is  TV 2  *n  pairs  on  the  set  ft  in  the  Theorem. 

E0KX1t.,.,X  )|x.  >  a. ,  i  ■  l»...»n)  is  increasing  in  a1f...,a  * 
x  n  l  l  x  n 


First  Proof :  This  follows  from  the  previous  theorem  and  Theorem  3.3 

of  Alam  and  Wallenius  (1976)  which  remains  true  under  the  assumption  that 
f(X)  >  0  on  ,  ftjCR1 

Second  Proof:  We  also  prove  this  result  by  giving  a  streamlined  version 
of  the  proof  of  Theorem  3.3.  It  is  sufficient  to  prove  the  result  by 
checking  the  monotonlclty  only  for  a^.  We  write 


E(*(X)|X1  >  alf  i-1 . n) 

•  E(. . .E(. . .E(*(X) |XX . Xn) . . . |XX , . . . ,Xtl ,X1>a1, . . . .Xn>«n) 


(2.1) 


|Xj>a^,  i*l, . . . ,n) 


Now  tha  TP ^  condition  implies  that  X^  Is  stochastically  increasing 

in  xj  “  xj*  j  ■  l,...,i-l  given  X^  >  afc,  k  ■  i,...*n.  Thus,  the 

quantity  E(. . ,E(*(X)  | . . .  |x.  X.  ,  -  x.  .  ,X .  >  a.,...,X  >  a  ) 

*■  xx  l— x  i-x  li  n  n 

is  increasing  in  x^,  J  ■  l,...,i-l,  Iterating  gives  that  the  quantity 
Inside  of  the  first  expectation  of  (2.1)  is  Increasing  in  x^.  Letting 
this  quantity  be  #(Xj)  yields  that 

E(.«J)|Xi  >  Sj.  i  “  l,...,n)  »  E(f(X1)|xi  >  a^,  i  •  l,...,n)  IncreaSM  in 
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since  Che  density  with  which  the  last  expectation  is  taken  is  T?2  (i.e 
has  monotone  likelihood  ratio)  in  a^  and  x^. 

Corollary  2}  Let  given  X,  a  scalar  random  variable,  be 

independent  with  the  densities  f^x^.X)  which  are  each  TP^  in 

x .  and  X  for  i  «  1 . n.  Then  X.  satisfy 

i  in 

P{X1  >  xA  |  Xj  >  Xj,  j  e  I)  are  increasing  in  x^ 

where  I  C  {1,2, . . . ,i-l ,i+l, . . . ,n> .  In  particular,  Xx . are 

what  ALLP  (1978)  call  right  tail  increasing  in  sequence  (see  the 
next  section) . 

Proof :  By  the  basic  composition  formula  (Karlin  (1968),  p.  16)  it 

follows  that  the  density  f(xJ . xn)  -  Jj^f ,X)g(X)dX  is 

In  pairs.  By  Corollary  1  the  result  follows  by  appropriate 
choice  of  and  allowing  certain  a^ 

3.  Relations 

The  implications  among  the  various  notions  of  bivariate 
dependence  are  summarized  in  Figure  5.4.1,  p.  146  of  Barlow  and 
Proschan  (1975).  In  the  same  book  are  introduced  the  multivariate 
(m  >  3)  concepts  of  TP^  in  pairs,  conditionally  increasing  in 
sequence  (CIS),  and  association.  Brindley  and  Thompson  (1972)  have 
discussed  the  concept  of  right  corner  set  Increasing  (RCSI).  Other 
concepts  discussed  by  ALLP  (1978)  are  given  below.  In  this  section 
we  completely  determine  the  relationships  among  all  of  these  concepts. 
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Definition  1:  A  sequence  of  random  variables  ^ . Xn  is  said  to 

be  ripht  tail  increasing  in  sequence  jRTIS)  if  P(xi+]  >  *1+1 '  >  *j}) 

is  increasing  in  x^,...x^  for  i  •  lt...,n-l. 

Definition  2s  The  random  variables  X, ,  ...,X  are  mutually 
-  I  n 

positive  orthant  dependent  (POD)  if 
n  n 

P(  O  (X^  >  x^})  >  w  P(X^  >  x^)  for  all  x^, . . .  ,x^. 
i*l  i=l 

Note  that  for  n  =  2  >  POD  coincides  with  the  concept  of  positive 
quadrant  dependence  (PQD)  studied  in  Lehmann  (1966). 

Alam  and  Wallenius  (1976)  introduce  the  concept  of  s*-positive 
dependence  which  in  terms  of  the  above  is  equivalent  to  every 
sequence  being  CIS.  These  authors  also  show  that  m*-positivel y 
dependent  implies  RCSI .  Hence,  by  C  :-"ll.nrv  1  wo  have  TP^  in  pairs 
implies  RCSI.  Ahmed,  Langherg,  Leon  apd  Proschan  show  that 

RCSI  RTTS  '  POD . 

The  first  implication  is  also  shovm  in  Brindley  and  Thompson  (1972). 

Barlow  and  Proschan  (1975)  show  that  TP^  in  pairs  implies 
conditional  increasing  in  sequence  (CIS).  And  the  result  that  CIS 
implies  association  is  given  by  Esary  and  Proschan  (1968).  The 
proof  that  association  satisfies  the  condition  of  POD  is  in  Esary, 
rro«*^han  -tod  WalVup  (1967). 

Since  in  the  bivariate  case  RT1S  implies  association,  (see 
Esary  and  Proschan  (1972)),  it  seems  reasonable  to  conjecture  that 
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RTIS  implies  association  in  the  multivariate  case.  However,  this 
is  not  true;  as  will  be  seen  by  a  counterex  *uple.  Brindley  and 
Thompson  (1972)  show  that  RCSI  does  not  imply  association. 

Association  does  not  imply  RTIS  (see  Esary  and  Proschan  (1972)). 
Hence,  association  does  not  imply  RCSI  neither. 

We  also  give  examples  to  show  that  RTIS  neither  implies  nor  is 

implied  by  CIS.  These  results  were  noted  by  ALLP  (1978),  hut  their 
example  need?  to  be  modified. 

For  RCSI  and  CIS,  there  is  no  implication  between  them  even  in 
bivariate  case  (see  Barlow  and  Proschan  (1975)). 

We  summarize  the  implications  among  the  notions  of  multivariate 
dependence  as  in  the  following  diagram,  where  I(X^,...,X^)  means 
Xi,...,Xn  are  independent. 

.  RCSI  ✓  RTIS 

I(X1,...,Xn)  TP2  in  pairs  '  J  POD 

~  CIS  /  association  ^ 

Any  other  implication  among  CIS,  RCSI,  RTIS  and  association  does  not 
hold.  In  the  above  it  is  understood  that  the  implications  yielding 
RTIS  and  CIS  hold  for  every  sequence,  but  the  implications  following 
from  these  concepts  require  the  condition  for  only  one  sequence. 

Example  1:  (RTIS  Association) 

Let  X^,  X^  and  X^  be  binary  random  variables  distributed  according  to 

r 

P(Xj  -  0,  X2  -  0,  X,  ■  1)  ■  0.2 
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P(Xj  =  0, 

* 

1 

<N 

X 

x3  -=  0)  =  0.1 

P(Xj  -  1, 

X2  =  0, 

X3  «  0)  -  0.1 

P(X3  =  1, 

X2  -  1, 

x3  =  0)  ■  0.1 

P(XX  -  1,  X2  *  1,  X3  -  1)  *  0,5  . 


It  is  easy  to  check  that  X^,  X^  and  X^  are  RTIS.  Let  t  1^ 
be  the  indicator  functions  of  the  sets  Uj  and  where 


vx  «  {(0,0,1),  (0,1,0),  (1,0,1),  (0,1,1),  (1,1,0),  (1,1,1)} 


u2  -  {(0,1,0),  (1,0,0),  (1,0,1),  (0,1,1),  (1,1,0),  (1,1,1)). 


Then  I..  ,  1  are  binary  Increasing  functions.  But 
U1  U2 

Cov[Iu^(X1,X2,X3),  Iy  (xltx2,x3)]  -  P[(X1,X2,X3)  €  ux  n  u2] 

-  P[(XlfX2,X3)  e  U31  P[(X1,X2,X3)  e  Uj]  =  0.7  -  0.72  <  0.  Thus, 


Xj,  X2  and  X3  are  not  associated. 


Example  2:  (CIS  ^  RTIS) 

Let  X3,  given  (X^,X2)  *  (x^,x2)  be  distributed  according  to  the 
normal  N(x3+x2,l)  and  let  (X^.Xj)  be  jointly  distributed  according  to 


Then  Xj,  X2  and  are  CIS,  but 


P(X3  >  2  |  Xj  >  -1,  X2  >  -1)  -  0.2774 


>  P(X3>2|X1>0,X2  >  -1)  =  u.1537 


i.e.  and  are  not  RTIS. 


Example  3:  (RTIS  ^p  CIS) 

Let  Xj,  Given  (X^X^)  53  be  defined  as  in  Example  2t  and 

let  X^,  X^  be  distributed  such  that 


K  - 

0 

1 

-1  0.05 

0.25 

0 

0  0.1 

0 

0.2 

1  0 

0.1 

0.3 

then  it  can  be  checked  that  X^,  X^  and  X^  are  RTIS  but 


P(X2  >  -1  I  X3  -  -1)  «  0.25/0.3 


P(X2  >  -1  |  X1  «  0)  -  0.2/0. 3  <  0.25/0.3 


therefore  X^,  X2  and  X3  are  not  CIS. 
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